Accommodations Toolkit
Signed Administration: Research
This fact sheet on signed administration is part of the Accommodations Toolkit published by the National Center on Educational Outcomes (NCEO). It summarizes information and research findings on signed administration as an accommodation.[1] This toolkit also contains a summary of states’ accessibility policies for signed administration.
What is signed administration? Signed administration is an accommodation where test directions or test questions/items are interpreted between spoken and sign language (e.g., American sign language – ASL) or other signed communication system (e.g., Signed Exact English – SEE) or translated from text into a sign language or other signed communication system (Cawthon, 2008, 2011). Translation is often provided by an in-person human interpreter (Cawthon, 2008, 2011; Russell et al., 2009), though it may be provided by a video (e.g., DVD, online platform) with a human interpreter (Higgins et all, 2016; Maihoff et al., 2000; Wang et al., 2017). Signed administration is often provided using ASL or Signed Exact English (SEE). ASL is commonly used by the deaf community in the United States and has a distinct language system based on English. Another signing system is SEE which employs the same grammatical rules as spoken English but uses hand gestures to represent words.
What are the research findings on who should use this accommodation? Research has shown that students who benefit from using signed administration on assessments are deaf or hard of hearing. It is useful for this population across all grade levels (Cawthon, 2011; Wang et al., 2017).
What are the research findings on the implementation of signed administration? Three studies were located that addressed implementation of the signed administration accommodation.
- A study of students who were deaf or hard of hearing in elementary through high school grades compared the use of computer-based high quality ASL videos for mathematics and English language arts tests to those without the accommodation. The results showed that ASL access with this accommodation had a positive impact on student performance (Higgins et al., 2016). One study of secondary students who communicated in ASL compared computer-based signed administration of a mathematics assessment via a human video to signed administration via a signing avatar on a mathematics test. There was no difference in test performance between the human video of signed administration and the signing avatar (Russell et al., 2009).
- Another study with secondary students who were deaf or hard of hearing compared sign-only administration to simultaneous sign and speech presentation for a reading assessment. Students were able to recall more information from the sign-only form of presentation. The author hypothesized that the students were able to recall more from the sign-only presentation because simultaneous speech and sign presentation may have compromised comprehension by competing for limited attentional resources (Wang et al., 2017).
What perceptions do students and teachers have about signed administration? Six studies addressed the perceptions of students or educators regarding signed administration.
- One study (Maihoff et al., 2000) examined the perceptions of test administrators regarding signing of a math test using a DVD with human interpreter as compared to in-person signing by a teacher. Test administrators reported that signing of the test on the DVD was clearer and a better presentation than having teachers sign to students.
- Three studies examined student perceptions on signed administration. There were mixed findings across the studies. Russell et al. (2009) found that most secondary students preferred a video that contained a human signing the test over a signing avatar in a mathematics test. All students indicated it was easier to take a test that was signed-administered on the computer regardless of format, though the study found there was no actual difference in students’ performance between the two formats. Maihoff et al., (2000) reported that students who were deaf or hard of hearing perceived a signed mathematics test to be easier to understand than the written paper only test. However, some students still preferred the paper test because it took less time to take. Higgins et al., (2016) conducted a study of students who were deaf or hard of hearing in elementary through high school grades. The study examined students’ perceptions of embedded ASL video support, which allowed English text and ASL to be presented simultaneously compared to a video with fingerspelling (i.e., individual letters of an English word or term are manually spelled) for mathematics and English language arts tests. The majority of students preferred videos of ASL signed by a human over no provision or ASL. The students reported this mirrored how instruction was presented in their classroom. Alternatively, students reported that they preferred ASL in combination with fingerspelling over the use of fingerspelling alone.
- Three studies investigated teacher perceptions on signed administration. One study found that teachers believed signed administration required more time than a standard administration of a test and that district and building testing schedules did not make allowances for this need (Johnson et al., 2001). A second study found that teachers frequently used ASL for math or reading tests with students across grade levels (Cawthon, 2008). Teachers reported that professional development was important to help ensure that test directions and items were translated using ASL without changing the test content. The third study (Cawthon, 2011) compared the perceptions of teachers who instructed students who were deaf or hard of hearing in math with the perceptions of teachers who instructed these students in reading regarding the usefulness of sign language interpretation for math and reading assessments. The teachers served students who were deaf or hard of hearing in different grade levels. The study found that teachers were more likely to recommend sign interpretation for math assessments than for reading assessments.
What have we learned overall? The research on the effect of signed administration on performance is limited but suggests that the signed administration accommodation is beneficial. Research findings also found no difference in performance between the provision of this accommodation via video-taped human interpretation and interpretation using an avatar—though students preferred the human interpretation. Research findings also suggest that students may do better with a signed only presentation than when signed and oral presentation are combined.
Several studies examined perceptions. Educators had mixed preferences for formats based on time efficiency, the type of content assessed, student skill levels, and self-capacity to provide quality signing. The findings suggested that educators needed professional development to enable them to more confidently select and implement the signed administration accommodation and any other accommodations that might be bundled with it (e.g., extended time). Similar to educators, students had mixed preferences regarding different formats and modes of signed administration in terms of ease and efficiency.
Additional studies are needed to compare performance of students who are deaf or hard of hearing with and without the signed administration accommodations across all grades. There is also a need for additional studies that compare various methods of providing this accommodation (e.g., in-person sign language interpretation as compared to videos of humans or avatars, etc.) especially at the elementary grades, for content assessments other than math or reading (e.g., science, social studies), and for students with disabilities other than deaf or hard of hearing (e.g., autism) who may benefit from different types of signed administration.
References
Cawthon, S. W. (2007). Accommodations Use for Statewide Standardized Assessments: Prevalence and Recommendations for Students Who Are Deaf or Hard of Hearing. Journal of Deaf Studies and Deaf Education, 13(1), 55–96. https://doi.org/10.1093/deafed/enm029
Cawthon, S. W. (2009). Making Decisions About Assessment Practices for Students Who Are Deaf or Hard of Hearing. Remedial and Special Education, 32(1), 4–21. https://doi.org/10.1177/0741932509355950
Higgins, J. A., Famularo, L., Cawthon, S. W., Kurz, C. A., Reis, J. E., & Moers, L. M. (2016). Development of American Sign Language Guidelines for K-12 Academic Assessments. Journal of Deaf Studies and Deaf Education, 21(4), 383–393. https://doi.org/10.1093/deafed/enw051
Johnson, E., Kimball, K., & Brown, S. O. (2001). American Sign Language as an Accommodation During Standards-Based Assessments. Assessment for Effective Intervention, 26(2), 39–47. https://doi.org/10.1177/073724770102600207
Maihoff, N. A., Bosso, E., Zhang, L., Fischgrund, J., Schulz, J., Carlson, J., & Carlson, J. E. (2000). The effects of administering an ASL signed standardized test via DVD player/television and by paper-and-pencil: A pilot study. Delaware Department of Education.
Russell, M., Kavanaugh, M., Masters, J., Higgins, J., & Hoffman, T. (2009). Computer-based signing accommodations: Comparing a recorded human with an avatar. Journal of Applied Testing Technology, 10(3). http://www.jattjournal.com/index.php/atp/article/view/48358
Wang, Y., Hartman, M. C., Jahromi, L. B., & Tversky, B. (2017). Better story recall by deaf children with unimodal communication. Journal of Developmental and Physical Disabilities, 29(5), 699–720. https://doi.org/10.1007/s10882-017-9551-3
Attribution
All rights reserved. Any or all portions of this document may be reproduced and distributed without prior permission, provided the source is cited as:
Goldstone, L., Lazarus, S. S., Hendrickson, K., Rogers, C., & Fleming, K. (2022). Signed administration: Research (NCEO Accommodations Toolkit #24a). National Center on Educational Outcomes.
The Center is supported through a Cooperative Agreement (#H326G210002) with the Research to Practice Division, Office of Special Education Programs, U.S. Department of Education. The Center is affiliated with the Institute on Community Integration at the College of Education and Human Development, University of Minnesota. Consistent with EDGAR §75.62, the contents of this report were developed under the Cooperative Agreement from the U.S. Department of Education, but do not necessarily represent the policy or opinions of the U.S. Department of Education or Offices within it. Readers should not assume endorsement by the federal government. Project Officer: David Egnor